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© Coding and decoding methods for a picture signal using overlapping blocks having variable block 
sizes and apparatuses therefor. 

© The described method and apparatus for coding and decoding a bidimensional signal of the present 
invention comprises at a coding side means for dividing a bidimensional input signal into rectangular blocks of a 
plurality of sizes, providing window functions h A M (m) and h B N (n) on a direction and block size basis, means for 
calculating, assuming that a block of interest has an M x N size, a transformed signal X p (k, i) from input signals 
x p (m, n) by means of a particular transform equation. The block division information and the transformed signals 
are transmitted to a decoding side. At the decoding side window functions f am (m) and f B N (n) corresponding to 
the window functions Ham (m) and Iibn (n), respectively, are provided for calculating, when a block size of the 
transformed signals sent from the coding side is M x N, inverse-transformed signals y p (m, n) of 2M x 2N points 
from the transformed signals. The inverse-transformed signals are arranged according to the block division 
information sent from the coding side, and the inverse-transformed signals are added, in a portion where a 
plurality of blocks overlap to produce a decoded signal. This system splits a bidimensional picture signal into 
picture blocks and is capable of decoding an input signal correctly even when blocks overlap and have a 
variable block size. 



BLOCK INFORMATION 



If) 

o 

CO 



Q- 

UJ 



SIGNAL 
INPUT 



Fig. 7 



DIVIDING 






LINEAR 






TRANSFORM 


CIRCUIT 




CIRCUIT 



BLOCK INFORMATION 



DECODED 
SIGNAL 



LINEAR 

TRANSFORM 

CIRCUIT 



SYNTHESIZING 
CIRCUIT 



2Mpx2Np 



Rank Xerox (UK) Business Services 



EP 0 467 054 A2 



BACKGROUND OF THE INVENTION 

The present invention relates to methods and apparatuses for coding and decoding a picture signal or 
similar bidimensional signal block by block. 

5 It is a common practice with the above-mentioned type of coding and decoding to divide a bidimen- 

sional signal into blocks each having a predetermined block size and then code and decode it on a block 
basis. The problem with this kind of coding and decoding scheme is that discontinuous changes in the 
signal, i.e., so-called block boundary artifacts occur at the boundaries of adjoining blocks. To reduce block 
boundary artifacts, a method which uses blocks having overlapping regions has been taught by, for 

w example, H. Schiller in "Overlapping block transform for image coding preserving equal number of samples 
and coefficients", SPIE, Visual communications and Image Processing '88, November 9-11. Schiller divides 
an image signal into blocks each having 2N x 2N pixels (N being a natural number) and overlapping 
adjacent blocks by half the block size in four directions which are perpendicular to the four sides thereof. 
An input pixel signal representative of 2N x 2N points is coded into a transformed signal representative of N 

75 x N points by transform equations which will be described later, and then the transformed signal is 
transmitted. The N x N transformed signal is transformed into a 2N x 2N inverse-transformed signal by an 
inverse procedure. Subsequently, this inverse-transformed signal and the inverse-transformed signals of the 
associated regions of the overlapping blocks are added to produce a decoded signal. A similar implementa- 
tion is taught in H.S. Malvan et al "The LOT: Transform Coding Without Blocking Effects", IEEE 

20 TRANSACTIONS ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, Vol. 37, No. 4, April 1989. On 
the other hand, it is known that when a bidimensional picture signal is divided into blocks and then coded 
and decoded, increasing the block size in regions where the change is insignificant and decreasing it in a 
region where the change is significant is successful in enhancing efficient coding and decoding. For 
example, Cheng-Tie Chen reported a unique procedure which splits a picture signal into non-overlapping 

25 bidimensional blocks of variable sizes and effects transform and coding in each of the blocks by Discrete 
Cosine Transform (DCT) in "Adaptive Transform Coding Via Quadtree- Based Variable Block Size DCT" at 
1989 INTERNATIONAL CONFERENCE ON ACCOUSTICS, SPEECH, AND SIGNAL PROCESSING, Volume 
3, MULTIDIMENSIONAL SIGNAL PROCESSING AUDIO & ELECTROACOUSTICS, held in Glasgow, May 
23-26, 1989. Specifically, a picture signal is divided into M x M relatively large blocks, and then each blocks 

30 is subdivided into N x N (N = M/2'; i being a natural number) unit subblocks whose number is the power of 
"4". Subsequently, the mean value of pixel levels is determined with each of four unit subblocks which 
constitute a 2N x 2N block. If the differences (4C2 = 6) among such unit subclocks are smaller than a 
predetermined value, the unit subblocks are combined into a 2N x 2N intermediate subblock and then dealt 
with as one of four 2N x 2N intermediate subblocks that constitute an 8N x 8N block. In this manner, the 

35 block size is sequentially increases so long as the conditions are satisfied. As a result, (i + I) kinds of block 
sizes at maximum, i.e., N x N to M x M block sizes may be generated, depending on the degree to which 
the conditions are satisfied. Coding and decoding are effected with each of such blocks to enhance 
efficiency. 

However, the Chen's coding and decoding scheme suffers from the previously stated block boundary 
40 artifacts since it divides an input signal into blocks such that the blocks do not overlap one another. The 
Schiller's method and Malvar's method both are not practicable unless blocks of the same size overlap, i.e., 
correct results of decoding are not achievable when blocks of different sizes are used. 

SUMMARY OF THE INVENTION 

45 

It is therefore an object of the present invention to provide a coding and decoding method of the type 
splitting a bidimensional picture signal into picture blocks and coding and decoding on a block basis and 
capable of decoding an input signal correctly even when blocks overlap and have a variable block size. 
It is another object of the present invention to provide a coding apparatus, decoding apparatus, and 
50 coding and decoding apparatus to which a coding and decoding method of the present invention is applied. 

A method of coding and decoding a bidimensional signal of the present invention comprises the steps 
of, at a coding side, dividing a bidimensional input signal into rectangular blocks of a plurality of sizes, 
providing window functions h A M (m) and h B N (n) on a direction and block size basis, calculating, assuming 
that a block of interest has an M x N size, transformed signal X p (k, i) from input signals x p (m, n) (m = 0, I, 
55 2M-I; n = 0, 1 2N-I) by a transform equation: 
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2M-1 2N-1 

X. (k, i) * 2 2 x 0 (m, n) h^dn) h BN (n) 

x cos { (2m + M + 1) (2k + 1) * / (4M) } 
x cos £(2n + N+l) (2i + l) ??/ (4N)] 

(k « 0, 1, . . «./ M-l; i = 0, 1, . K-l) 

75 and transmitting block division information and the transformed signals to a decoding side, and at the 
decoding side providing window function f AM (m) and f B N (n) corresponding to the window functions h A M (m) 
and h B N (n), respectively, calculating, when a block size of the transformed signals sent from the coding 
side is M x N, inverse-transformed signals y p (m, n) of 2M x 2N points from the transformed signals by 
using a transform equation: 



20 



25 



30 



M-l N-l 

y (m, n) = 1 2 X (k, i) f AM (m) f BN (n)/(MN) 
p k»0 i-0 p 

x cos {(2m + M+l) (2k* 1) ?r/(4M)} 
x cos {(2n + N+l) (2i+l) >r/(4N)} 
• (xc « 0, 1, 2M-1? n = 0, 1, 2N-1) 



arranging the inverse-transformed signals according to the block division information sent from the coding 
35 side, and adding, in a portion where a plurality of blocks overlap, the inverse-transformed signals to produce 
a decoded signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 The above-mentioned and other objects, features and advantages of the present invention will become 
more apparent from the following detailed description when taken in conjunction with the accompanying 
drawings, wherein: 

Figs. 1a-1c and Fig. 2 show a specific conventional relation of overlapping blocks to one another; 
Figs. 3a-3c show regions of an input signal used in calculating transformed signals in accordance with 
45 the present invention; 

Figs. 4a-4c show window functions; 

Figs. 5a-5d illustrate how a composite signal of overlapping regions of two blocks is calculated; 
Fig. 6a shows blocks contacting from opposite side with respect to a given line; 
Fig. 6b illustrates how a composite signal of overlapping regions of two blocks is calculate; 
50 Fig. 7 is a block diagram schematically showing apparatuses for coding and decoding a bidimensional 
signal embodying the present invention; 
Figs. 8a and 8b each shows a specific block division principle; 

Figs. 9a and 9b are block diagrams each schematically showing a specific construction of a decision 
circuit; 

55 Fig. 10a is a block diagram schematically showing a specific construction of a linear transform circuit 2; 
Fig. 10b is a schematic block diagram showing a specific construction of a linear transform circuit 3; 
Fig. 11a is a block diagram showing a specific construction of a window function generating circuit 17 
included in the linear transform circuit 2; 



3 
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Fig. 11b is a block diagram schematically showing a specific construction of a window function 
generating circuit 27 included in the linear transform circuit 3; 

Fig. 12 is a table listing a relation between the output of a data counter 51 and the output of a counter 34 
shown in Fig. 11a; 

5 Fig. 13 is a table listing the addresses of a ROM 35 shown in Fig. 11a and specific contents stored 
therein; and 

Fig. 14 is a block diagram showing a specific construction of a synthesizing circuit 4 shown in Fig. 7. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



w 



To better understand the present invention, a brief reference will be made to the conventional method 
taught by Schiller, shown in Figs. 1a-1c. The figures show only a given block of interest (block P) and other 
blocks (blocks 1-8) overlapping the block P, for the sake of simplicity of description. As shown, the block P 
is constituted by a 2N x 2N pixel signal and overlaps blocks 7 and 8 (Fig. 1c) and blocks 5 and 6 (Fig. 1b) 
15 in directions x and y, respectively, by half the block size each. Further, the block P overlaps blocks 1 and 3 
which overlap the block 5 in the direction x by half the block size and blocks 2 and 4 which overlap the 
block 6 in the direction x by half the block size, over an N x N region (Fig. 1a). Hence, the block P overlaps 
with eight blocks in total. The blocks shown in Figs. 1a-1c appear as shown in Fig. 2 when seen from the 
above. 

20 Assume that the input 2N x 2N pixel signal representative of the block P of interest is x p (m, n) (m = 0, 

1 2N-I; n = 0, 1 2N-I). Then, the input 2N x 2N pixel signal is coded into an N x N transformed signal 

Xp (k, i) by a predetermined window function W (n) (n = 0, I, 2N-I) and an equation: 



25 



30 



35 



45 



50 



55 



2N-1 2N-1 



X <k, i) « I £ x (m, n) • W(m) • W(n) 

P rt*0 n«0 p 

x cos { (2m + N+ 1) • (2k + 1) */(4N.)] 

x cos {(2n + N-l) • (2i + l) ?r/(4N)J 



(1) 



(k = 0, 1, N-l; 1=0, 1, . N-l) 



The transformed signal X p (k, i) is transmitted. The equation (I) corresponds to subsampling signals at 2N x 
2N points in the frequency domain. For decoding, inverse-transformed signals are produced from the 
40 transformed signals X p (k, i ) by the window function W (n) used for coding and an equation: 

v (a, n) « I 2 (k, i) W(m) w(n)/N* 

? k»0 i-0 p 



x cos { (2m + N + 1) (2k + 1) * / (4N) } 
x cos { (2n + N + 1) (2i + 1) at/ <4N>) 

.... (2) 

(m « 0, 1, ,.. f 2N-1; n = 0, 1, ...r 2N-1) 

The inverse-transformed signals of all the blocks which occupy the same space are added to produce a 
decoded signal. As shown in Fig. 2, any region inside the block P overlies four blocks. Hence, the inverse- 
transformed signals corresponding to the same regions of the overlapping four blocks are added to produce 
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a decoded signal. Decoded signals at the block boundaries can also be produced if the inverse-transformed 
signals of the plurality of blocks are added, whereby block boundary artifacts are reduced. Since the blocks 
overlap, decoding is possible even when signals at 2N x 2N points are sampled at N x N points. Complete 
decoding (neglecting quantization errors at the time of coding and transmission) is achievable if the window 
5 function W(n) satisfies the following conditions: 

Condition 1 - the window function is symmetrical in the right-and-left direction. 

Condition 2 - the sum of power is always 1 (one) when turned back at the center of each of the 
symmetrical right and left regions, at points which are one-fourth of the entire window function from the 
right and left ends. 
w Expressing the above conditions in equations, 



75 



20 



Condition 1: W(n) * W (2N - 1 - n) 

(n » 0, 1, N - 1) 

Condition 2; W 2 (n) + W 2 ( fif - 1 - n) = 1 

(n • 0, lr - » - f N/2 - 1) 



The problem with such a window function is that it cannot be used unless the blocks overlapping one 
another by half the block size are identical in size. 

The present invention divides a bidimensional input picture signal into a plurality of blocks each having 

25 a particular size by use of some basis. Specifically, the basis to be used may be implemented as the 
previously mentioned Chen's method or any other method which is selected by comparing the amounts of 
code, the lower range power intensity, etc. Assuming that a block of interest (hereinafter referred to as a 
block P) has an M (horizontal) x N (vertical) block size, the present invention performs coding by using input 
signals representative of a 2M x 2N range centering around the block P. Assuming that input signals of the 

30 2M x 2N points are x p (m, n) (m = 0, 1 2M-I; n = 0, 1 2N-I), then they are coded into coded signals 

X p (k, i) of M x N points, as follows: 

2M-1 2N-1 

X (k, i) = 2 I x (m, n) h^Cm) h fiM (n) 
35 P iti-0 n=0 ¥ 

x cos {<2m + M+ 1) (2k + 1) ff/<4M)j 

40 x cos { (2n + N + 1) (2i + l) */(«)} 

(k « 0, 1, M-l; i = Or If N" 3 -) 

*5 (3) 



where h A ivi(nn) and h B i\i(n) are window functions prepared beforehand on the basis of horizontal and vertical 
directions (A, B) and block sizes (M, N). 
50 The transformed signal X p (k, i) is transmitted together with block division information which may be, for 
example, the origin and the horizontal and vertical sizes of the block. Regarding decoding, the present 
invention produces an inverse-transformed signal y p (k, i) of the transformed signal x p (k, i) by using window 
functions f A M(nn) and f B i\i(n) prepared beforehand in association with the above-mentioned window functions 
hAM(m) and h B ivi(n) and an equation: 
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10 



M-l N-1 

7 (m, n) = I 2 X (k, i) f^ta) f fiN (n)/(MN) 
p k»0 i=0 p 

x co« { (2m + M+ 1) (2k ♦ 1) */(4M)] 

x cos { (2n + N + 1) (2i + 1) JT/(4N)} 

(m ■ 0, 1, 2M-1; n - 0, 1, . 2N-1) 

(4) 



75 



Subsequently, the inverse-transformed signals y p (m, n) are arranged on the basis of the block division 
information sent from the coding side. In each portion where a plurality of blocks overlap, the inverse- 
transformed signals are added to produce a decoded signal. As shown in Fig. 3b, let the 2M x 2N block be 
divided into four regions 1-4 for illustration. Assume that transformed signals X p (k, i) without any block 
20 broundary artifacts are decoded. Then, by substituting the equation (3) for the equation (4), the inverse- 
transformed signals y p (m, n) in the regions 1-4 are expressed by use of the input signals x p (m, n), as 
follows. 

In the region I (m = 0, I M-l; n = 0, I N-l) 



25 



30 



35 



y p (m, n) * x p * m ' nJ h AM (lfl) f AM< m ) h BN ( - nl f BN (n) 

- x IM-l-n, n) h^Ol-l-m) h^Ou) h BN (n) f BN (n) 

- x p (n, N-l-n) h^Cm) f^to) h BM (N-l-n) f B tf(n) 
+ x p (M-l-rn, N-l-n) h AM (M-l-m) f^m) 

xh BN (K-l-n) £5^(11) (5. a) 

In the region 2 (m = M, M + 1 2M-I; n = 0, I N-l) 

y (m, n) = x (m, n) h AM (m) f^tm) h BN (n) f BN (n) 

40 gf 

+ x (3M-l-m, n) h^OM-l-a) f^dn) h BN (n) f BM (r.) 
- x p (m, N-l-n) h^m) fAMdn) h BN (N-l-n) f B >j (n) 
45 - x (3M-l-m, N-l-n) hjjjOM-l-m) fAM (m) 

x h fiN (N-l-n) £ BN (n) (5.b) 

50 In the region 3 (m = 0, I, M-l; n = N, N + l, 2N-I) 



55 
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y (.-n, n) * X-to* n ) ^^(m) f^U) h BN (n) f BN (n) 

P ¥ 

- x (M-l-m,n) h^CM-l-m) f AM (n) h BN (n) f BN (n) 

5 P 

+ x (m,3R-l-xO h^jtm) t m W h BN (3N-l-n) f BN (n) 

- x (M-l-ia, 3N-l-n) h aM (M-l-m) ^(m) 

10 P 

x h BN (3N-l-n) f BN (n) (5,c) 

75 In the region 4 

(m = M.M + I, 2M-I 9 
n = N, N + l, 2N-I) 



20 y p (m, n) = x (m, n) h^to) f am (m> h BN (n) £ BN (n) 

i- x p (3M-l-m,n) h^OM-l-m) f w (n) h BN <n) * B N (n) 

25 + x p (m,3N-l-n) h^dn) t^im) h BN (3M-l-n) f 3N (n) 

* x (3H-l-m, 3N-l-nJ h M (3M-l-n) f AM (lt ° 

30 x h BN (3N-i-n) f BN (n) (5.d) 



On the other hand, assume that the minimum block size is Mo x No that the window functions of the 
35 coding side which correspond to the horizontal direction M 0 and the vertical direction N 0 are h A Mo (m) and 
hBNo (n), respectively, and that the window functions at the decoding side are f amo (m) and f B No (n). Then, in 
order that input signals equally divided into minimum blocks may be regenerated, the following conditions 
should be satisfied: as to window functions h A Mo (m) and f amo (m) in horizontal direction 



40 



45 



50 



h AMO (m) f AMO (m) + h AMO (!tt+M 0 J f AMO {xn+M 0 } = 1 

(0 m < m 0 ) .... (6. a) 

h AM0 (2M 0 -l-m) (ic + Mq) = (M Q - X-m) (m) 

(0 £ m < M Q ) (6.b) 

as to window functions h B No (n) and f bno (n) 



55 
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h BNO (n) f BNO (n) + h BNO < n+N 0 ) f BNO (n+N Q ) = 1 

(0 * n < N 0 ) (6.C) 

5 

h BNO (2N 0 -l-n) f BN0 (n + N 0 ) = h BN0 (N 0 - 1-n) f BN0 (n) 
w (0 ^ n <: N 0 ) (6-d) 

The window functions h A M (m), h B N (n), fAM (m) and f B N (n) for the other blocks should satisfy the 
following conditions as derived from the signal decoding conditions particular to the equally divided block 
15 size (M 0 x N 0 ) and the signal decoding conditions at a point where blocks of different sizes, especially a 
block of M x N size and a block of M 0 x N 0 size, adjoin each other: 



20 
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20 



30 



35 
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h^Ua) = ^(31) - 0 (m <TM/2 - M Q /2) (7. a) 

■ hAModa-M/2 + M 0 /2) f amo^ - M/2 + M 0 /2) (7.b) 

(M/2 - M 0 /2 ^ m < M/2 + Ma/2) 

h AM (M-l-m) f AM (») 

« h AM0 (M/2 + M c /2-l-m) f AMO (ffi-M/2 + M 0 /2) (7.c) 

(M/2 - M 0 /2 £ n < M/2 + M Q /2) 



h m (m) f AM (n) =1 t7.fi) 

25 (M/2 + M 0 /2 ^ m 3M/2 - M Q /2) 

h AM (m) f AM (n) 

85 h AMO " 3M '' 2 + 3M o/ 2 > £ AMO (n " 3M/2 * 3M o/ 2 > 



(7.e) 



(3M/2 - M 0 /2 £ m < 3K/2 + M Q /2) 



* l^AMO < 3M / 2 * 3Mo/2-l-n) f M10 (m- 3M/2 + 3M Q /2) 

.... ( 7 • f ) 
(3M/2 - M 0 /2 £ m < 3M/2 + M Q /2) 

h AM (!n) • ffti-idti) - 0 (m S 3M/2 * M 0 /2) (7.g) 

h BN (n) = fBN^) =0 (n < N/2 - N 0 /2) (7.h) 
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- h BNO (n-N/2+N 0 /2) f BNO (n-N/2*N 0 /2) .... (7.i) 

(N/2 - N 0 /2 £n <N/2 * N 0 /2) 

h BN (K-l-n) f BN (n) 

" h BNO (N/2 * N 0 /2-l-n) f BN0 (n " N/2 * N 0 /2) (7 * j) 

(N/2 - N 0 /2 £ n <M/2 ♦ N Q /2) 

h B N< n) f BN (n) ■ 1 {7 * k) 

(N/2 + N 0 /2 £ n -C 3N/2 - N Q /2) 

h BN (n) f BN (n) 

= hBNO< n ~ 3N / 2 + 3 *V 2 > f BNO< n " 3N / 2 * 3l V 2 > 

(7.1) 

(3N/2 - N 0 /2 ^ n< 3N/2 + Nq/2) 

h BN (3N "" 1 " n) f BN (n) 

« h BNO (3N/2 + 3N 0 /2-l-n) f BNO (^ - 3N/2 * 3Nq/2) 

.... (7.m) 

(3N/2 - N 0 /2 ^n«C 3N/2 + N Q /2) 

h BN (n) = £ B u<n) " 0 * (7,n) 

(n £ 3N/2 * N 0 /2) 

The above equations are representative of the conditions for an input signal to be reconstructed even 
when a block of any size adjoins the M x N block. Among such equations, (7.a) - (7.g) are associated with 
the window functions h A M(m) and fAwi(m) in the horizontal direction while (7.h) - (7.n) are associated with the 
window functions h B N<n) and f B Ki(n) in the vertical direction. What each of the equations means will be 
described hereinafter. Since the equations (7.a) - (7.g) and the equations (7.h) - (7.n) are identical except for 
the replacement of M and N, let the following description concentrate on (7.a) - (7.g). Fig. 4a plots a 
waveform representative of sections where the Product h A M<m)*f AM (m) of the window functions h A M(m) and 
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fAM(m) in the horizontal direction and the equations (7.a) - (7.g) correspond. The equations (7.a) and (7.g) 
mean that the transformed signals in this region are not effected by the input signals and do not effect the 
decoded signals in the associated region. The equation (7.d) can be obtained from the equations (7.a), (7.g) 
and (6.a) with M 0 = M. The equations (7.b), (7.c), (7.e) and (7.f) indicate that the product of h A M and f AM is 

5 equal to the product at the same position of the window functions h A Mo and f A Mo associated with the 
minimum block size Mo x No. Assume that two blocks of the minimum size adjoin an M x N block. In such a 
case, the products h AM (m) - f AM (m) of the horizontal window function h AM (m) for coding and horizontal 
window function f A M(nn) for decoding in the individual blocks have a correlation shown in Figs. 4b-4d. As Fig. 
4a indicates, h AM (m) and f AM (m) each has more than (M + I) signal points which are not zero. Since these 

w window functions correspond to a block whose size in the horizontal direction is M, that the block of interest 
has more than (M + I) signal points which are not zero means that it overlaps other blocks. The above- 
description of the equations and window functions are also true with the window functions h B M(n) and feM(n) 
associated with a block whose size in the vertical direction is N. 

A procedure for producing an inverse-transformed signal y p (m, n) from a transformed signal x p (m, n) 

75 by use of the window functions h AM (m), h B N(n), f A M(m) and f B i\i(n) that satisfy the equations (7.a) - (7.n) will 
be described, taking the region 2 (M ^ m ^ 2M - I, 0 ^ n ^ N - I) shown in Fig. 3b as an example. As shown 
in Fig. 4a, in this particular region, the horizontal window functions have three different conditions, 
depending on the position in the horizontal direction. Namely, there exist a region (M ^ m ^ 1/2 (3M - Mo) - 
I) derived from the equation (7.d), a region (1/2(3M - M 0 ) ^ m ^ 1/2(3M + M 0 ) - I) derived from the 

20 equations (7.e) and (7.f), and a region (1/2(3M + M 0 ) ^ m ^ 2M - I) derived from the equation (7.g). While 
this region is subdivided into three regions with respect to the position in the vertical direction also, the 
following description will concentrate on the horizontal direction since the same description applies to both 
of the horizontal and vertical directions. 

To begin with, in the region (m = M, M + l, 3M/2 - M 0 /2 - 1; n = 0, I N-l) (21, Fig. 3c): 

25 from the equation (7.d) 

h AM (m) f AM (m) = I (8.a) 
from the equation (7.g) 

30 

h AM (3M-l-m) f AM (m) = 0 (8.b) 
Hence, substituting for the equation (5.b) 
35 r 

y p <m, n) « f B N (n) { x p (xn ' n) h BN ln) 

- x (m, N-l-n) h BN (N-l-n)] 

40 * 

(9) 



In the region (m = 3M/2 - M 0 /2, 3M/2 - M 0 /2 + 1 3M/2 - M 0 /2 - I; n = 0, I N-l) (22, Fig. 3c): 

45 from the equations (7.e) and (6.a) 

h AM< m > f AM (in) * 1 " h AM0 (™-3M/2 + Mg/2) 
so x f AM0 (itt-3M/2 + M 0 /2) (10. a) 

from the equations (7.f) and (6.b) 

55 
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5 



h M (3M-l-m) f^ta) = h^ M0 (3M/2 + M 0 /2-l-m) 

x f AM0 (m ~ 3M/2 + M 0/ 2 ) 



(10. b) 



Therefore, 



w 




15 



f BN (n) { (W-3M/2 - M 0 /2) (m-3M/2 + Mq/2)] 

x{x p (n, n) h BM (n) - x p (m, N-l-n) h^CN-l-n)] 
+ h m0 (3M/2 + M 0 /2-l-m) f AM0 (m-3M/2 + M Q /2) f BK '(n) 



20 



x$x (3M-l-m, n) h BN (n) 



- x (3K-1-IP-, N-l-n) h BN (N-l-n)] 



(IX) 



25 



Finally, in the region (m = 3M/2 + M 0 /2, 3M/2 + M 0 /2 + I, 2M-I; n = 0, I, N-l) (23, Fig. 3c): 
from the equation (7.g) 

h A M(m) f AM (m) = h Am (3M-i-m) f A M(m) = 0 

30 

Hence, 

y p (m, n) = 0 (12) 



The relationship described with reference to Fig. 4a also holds true for the vertical window functions 
h BN (n) and f B N(n). Therefore, by applying the conditions of three regions to the vertical window functions 
h B N(n) and f BN (n) included in the equations (9) and (11) which are representative of inverse-transformed 
signals, as has been the case with the horizontal direction, it is possible to represent inverse-transformed 

40 signals y p (m, n) of a block of any size by the window functions h AM o(m), f A Mo(nn), h BN0 (n) and f B N 0 (n) of the 
block of the minimum size (M 0 x No). 

Fig. 5a shown a specific condition wherein a block Q of M Q x N Q size and having the same minimum 
value (n = N/2) in the vertical direction as the block P of M x N size is located at the right-hand side of the 
block P. The input signal x p (0, 0) of the block P is the origin of the axes since the input signals of 2M x 2N 

45 points are used to code a block of M x N size, as stated earlier. Likewise, the input signal x Q (0, 0) of the 
block Q is {(3M - M Q /2, (N - N Q /2)} . In the following description, a position in the block Q will be 
represented by coordinates (m', n') relative to the original {3M - M Q /2, (N - N Q )/2}. Hence, x p (m, n) and x Q - 
(m', n*) are related as follows: 

so x Q (m 1 , n') = x p (nV - Mq/2 + 3M/2, n' - N Q /2 + N/2) (14) 

(m* = 0, I, 2M Q -I; n' = 0, I, 2N Q -I) 

In the region of the input signals (inverse-transformed signals) of the block Q, Fig. 5b, inverse- 
transformed signals y Q (m\ n') in the upper left zone (m' = 0, I M Q -I; n' = 0, I N Q -I), for example, are 

55 produced as follows. The inverse-transformed signals of the block Q can be represented by the equations 
(5. a) - (5.d) if m, n, M, N, x p , y p , h AM , f A m> h BN and f BN of the equations are replaced with m', n', M Q , N Q , x Q , 
ya, h AM Q, f A mqi h BNQ and f BNQ . Therefore, by using the equation (5.a), 



35 
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y Q (m' , n') 

■ x Q (m', n') h AMQ (m') f amq t m ' ) h BNQ< n<) f BNQ (n,) 

- x Q (MQ-l-m', n') ^amq IMg-l-m 1 ) 

X fAMQ(»'> h BNQ< n '> f BNQ (n '> 

- x Q (m' f N Q -l-n') h^dn') £ AMQ (m' ) 

x h B s Q (NQ-l-n*) f B NQt n,) 
+ x Q (Mq-I-hi', N Q -l-n') 

x h AMQ (MQ-l-m') fAMQdn'J 

* h BSQ (S Q -l-n') fflNQCn') (15) 

Assume that the window functions h A MQ, f amq> h B NQ and f bnq satisfy equations (7.a') - (7.n') which has 
m', n', M Q and N Q in place of m, n, M and N of the equations (7.a) - (7.n). Let the equation (15) be solved 
with each of three zones 51-53, Fig. 5b, having different window function conditions. First, in the zone 51 
(m' = 0, I Mq/2 - Mq/2-I; n" = 0, I N Q -I), from the equation (7.a') 

fAMa(m') = 0 (16) 

Substituting it for the equation (15) 

y Q <m\n') = 0 (17) 

In the zone 52 (m' = M Q /2 - Mq/2, Mq/2 - 2Mq/2 + I, Mq/2 - Mq/2-I; n" = 0, I N Q -I), from the equations 
(7.b') and (7.c') 



(18) 



= VmO (M Q /2 + Mq/ 2 -^' ) f A_MO (in ' " V 2 + "O 725 



(19) 



Again, substituting it for the equation (15) 
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y Q (m ' , n * ) 

= h AM0 (m- - Mq/2 + Mq/2) tzuQ (n« - M Q /2 + Mq/2) f fiNQ (n « ) 
x {xgdn 1 , n* ) h BNQ (n') 

- x Q lm' , N Q -l-n') h BNe (N Q -l-n')) 

- h AM0 (M Q /2 +Mo/2-l-m'J f^odn' -Mq/2 * Mq/2) 
x £ BNQ (n,) { ^(MQ-l-n' , n') h BNQ (n') 

- XqCMq-I-ici', NQ-l-n 1 ) ^BNQ (Nq-I-h • ) ^ 

e h AMO (m ' " V 2 *V 2) f AM0< m ' " V 2 + M 0 /2) f BNQ (n '> 
x fx <m' -Mq/2 + 3M/2, n' -N Q /2 + N/2) h BNQ (n«) 

- x (m* -Mq/2 * 3M/2, Nq/2 + N/2-l-n« ) h BNQ (N Q -l-n ' ) } 

" h AM0 (M Q /2 ♦M 0 /2-l-m') 

x f AMO (ra ' "V 2 + V 2) f BXQ< n,) 
x {x (Wq/2 + 3M/2-l-m\ n'-N Q /2 + N/2) h BNQ (n'J 

- x p (MQ/2 * 3M/2-l-m' , Nq/2 + N/2-l-n' ) 

x h BNQ (NQ-l-n « ) ] (20) 

In the zone 53 (nV = Mq/2 + Mo/2, Mq/2 + Mo/2 + 1 M Q -I; n' = 0, I N Q -I), 

hAMa(m') f A MQ(m') = I, 
hAMQ(M Q -l-m') f A MQ(m') = 0 

Therefore 
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■ f ENQ (n,) t x Q< m *' n '3 h BNQ< n '> 

" x Q (»«, N Q -l-n«) h BNQ (N Q -l-n') } 

- fBNQ(n') (x p (m' -Mq/2-*3M/2, n' -N Q /2+N/2) h BNQ (n») 
- x p (m' - Mq/2 + 3M/2, N Q /2 + N/2-l-n») 

x h BNQ (N Q -l-n ' ) } 

In the region extending from the upper right portion of the block P to the upper left portion of the block 

Q (m = M.M + I (3M + M Q )/2-l; n = 0, I min {N, (N + N Q )/2} -I), the inverse-transformed signals of the 

block P and those of the block Q are combined to produce a composite signal x pQ (m, n), as follows. In the 
zone m ^ (3M + M Q )/2 (56, Fig. 5c), the inverse-transformed signal y p (m, n) is zero from the equation (13). 
In the zone m ^ (3M-M 0 )/2 (54, Fig. 5c), the inverse-transformed signal y Q (m\ n*) is zero from the equation 
(17). In the zone N ^ (N-N 0 )/2, the inverse-transformed signal y p (m, n) = y Q (m*, n') is zero. To begin with, 
the composite signal x pQ (m, n) particular to the zone 54 is determined from y Q (m\ n 1 ) = 0 and the 
equation (9): 



x pQ (m, n) = y (m, n) 

= f BN (n) (x p (m r nj h BN <n) ~ x p (m, M-l-n) ^gjj (N-l-n) ) 

(24) 

In the zone 55 (m = (3M-M 0 )/2, (3M-M 0 )/2 + 1, (3M + M 0 )/2-l); n = 0, I, min{ N, (N + N Q )/2 } ), from the 
equations (11) and (20) 



x pQ (m,n) » y (ro,n) + y Q (m - 3M/2 ♦ Mq/2 , n + N Q /2-N/2) 

» *BN<»> { l-h AMO (m-3M/2*V 2) f AMQ<^ 3M/2 +V 2) ) 
x^x p (m,n) h BN (n) - x p ( m ' N-l-n) h BN (N-l-n)} 
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+ +xMo/2-l-n) f AMO (m-3M/2 + Mq/2) f BN (n) 

x {x p {3M-l-m,n) h BN .(n) 

- x p (3M-l-m, N-l-n) h BN (N-l-n)} 

* h AM o(m-3M/2 + Mq/2) £ All0 (m-3M/2 * Mo/2) 

x f BNQ (n*N Q /2-N/2) 
x{x p (m / n) h BNQ (n+N Q /2-N/2) 

- x p (m, N-l-n) h BNQ (N Q /2 + N/2-l-n)} 

- haMoOM/2 + Mo/2-l-m) f AMO (m-3M/2 + Mq/2) 

x f BNQ (n+N Q /2-N/2) 
x {x p (3M-l-m,n) h BNQ (n+N Q /2-N/2) 

- x p (3M-l-m, N-l-n) h BNQ (N Q /2 * N/2-l-n)} 

» f B «(n) (x p (m,n) h BN (n) - x p (m,N-l-n) h BN (N-l-n)} 

+ f mQ (t&-2K/2 + Mq/2) 

x (x p (3M-l-m,n) (3M/2 + Mq/2-I-mi) 

- x p (m, n) h AMO (n»-3M/2*Mo/2)"} 
x (h BN (n) f B N(n) - b B NQ(n+N Q /2-N/2) 

x £ BNA (n+N Q /2-N/2)] 

+ f AMO (m-3M/2 +Mq/2) 

x{x p (ra, N-l-n) h AMO (m-3M/2 + Mq/2) 

- x p (3M-l-ra, N-l-n) 1^0(314/2 + Mo/2-l-m)} 

x { h B1J (N-l-ri) f BN (n) 

" h BNQ (N Q /2+N/2-l-n) f BNQ (n+N Q /2-N/2)] 

(25) 

In the equation (25), the first term is equal to the composite signal of the zone 54 (equation (24)). In the 

zone 56 (m = 3M/2 + M 0 /2, 3M/2 + Mq/2 + I 3M/2 + Mq/2-I; n = 0, I min {N, (N + N Q )/2}-l), since y p - 

(m, n) is zero as stated earlier, 
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x pQ (m, n) - y Q (m-3M/2+MQ/2, n+N Q /2-N/2) 

* f BNQ (n+N Q /2_N/2) ( x p (m ' n) h BNQ (n+N Q /2 " N/2) 
- x (m, N-l-r.) h B1}Q (N Q /2+N/2-l-rx}} 

Regarding h B N(n) and feN(n), from the equations (7.h) - (7.n) of window functions. 
h BN (n) f BN (n) 

'0 (n ■ 0, 1, N/2-N 0 /2-l) (27. a) 

h B5JO (n-N/2+N 0 /2) f BNO (n-N/2+N 0 /2) (27. b) 

(n = N/2-N 0 /2, N/2-N 0 /2+l, N/2+N 0 /2-l) 

1 (n=N/2+N 0 /2, N/2+N 0 /2*l, . .., N-l) (27. c) 

hBn(K-l-n) fBN^) 

' 0 (n » 0, 1, N/2-N 0 /2-l) (28. a) 

h BNO (N/2+N 0 /2-l-n) f B NO (n-N/2+N 0 /2) (28, b) 

(ft = N/2-N 0 /2, N/2~N 0 /2+l, . .., N/2+N 0 /2-l) 

0 (n*N/2+N 0 /2, N/2*N 0 /2+l, N-l) (28. c) 



On the other hand, regarding h BN Q (n + N Q /2-N/2) and f BN Q (n + Nq/2-N/2), 
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h BNQ< n ') f 3NQ< n, > 



(n' 



*BNQ 



0, 1, . .., (Nq-N 0 )/2-1) (29. a) 

N n N 0 No Nn 



(n'=(N Q -N 0 )/2, (Nq-N 0 >/2+1, . .., (N Q +N 0 )/2-l) 

1 (n* • (N Q +N 0 )/2, <Nq+No>/2+1, . .., N Q -1) 

.... (29. C) 

(N-l-n») f B NQ< n '> 

in' = 0, 1, (N Q -N 0 )/2-l) (30. a) 

*BNO ( T + T " 1 " * > £ BNO («' ' ■? + 

(30. b) 

(n«»(N Q -N 0 )/2, (N Q -N 0 )/2+l, (N Q +N 0 )/2-l) 



^0 (n* - (N Q +N Q )/2, (N Q +N 0 )/2+l, N Q -1) 



(30. c) 



Therefore, 



h BN0 (n+N Q /2-N/2) f 3NQ (n+N Q /2-N/2) 

0 (n = 0, 1, N/2-N 0 /2-l) (31. a) 

h BNO (n-N/2+N 0 /2) f BN0 (n-N/2+N 0 /2} (31. b) 

(n = N/2-N Q /2, N/2-N D /2«-l, . N/2+N 0 /2-l) 



1 (n=N/2+N 0 /2, N/2+N 0 /2*l, . . . , + - 1] 



(31. c) 
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70 



75 



h B jj Q (N Q /2 +N/2-1-H) f BNQ {n + N Q /2 - N/2) 



r 



0 (n»0, 1, N/2-N 0 /2~l) (32. a) 

h BNO <N/2+N 0 /2-l-n) f BNO (n-N/2+N 0 /2) (32. b) 

(n=N/2-N 0 /2, N/2-N 0 /2+l, , .•, N/2+N 0 /2-l) 

0 (n«N/2+N 0 /2, N/2+N Q /2+l, . N/2 * N Q /2-l) 

. . , . (32.c) 



From the equations (24), (25) and (26), the composite signal x PQ (m, n) of the blocks P and Q in the zones 
54-56, Fig. 5c (m = M, M + l, (3M + M Q )/2-l; n = 0, I, min {N, N/2+ N Q /2} - 1) 



20 



25 



30 



35 



40 



45 



x pQ (m, n) 



n « 0 , I , 



* , N/2 - Nq/2-1) 



(33. a) 



x (m, n) h BNO (n-N/2+N 0 /2) f BN0 (n-N/2+N 0 /2) 
- x p (m, N-l-n) h EN0 (N/2 + N 0 /2-l-n) 
x £ BNO (n-N/2+N 0 /2) 



(33. b) 



{m»M, M+l, . (3M+Mq)/2-1; 
n«N/2-N 0 /2, N/2-N 0 /2+l, N/2+N 0 /2-l) 



x (ra, n) (ro = M, M+l, . .., (3M+Mq) /2-1; 



Nq 



n*N/2+N 0 /2, N/2+N 0 /2+l, . . . , min (N-l, N/2+-^-l) 

• . • . (33 .c) , 



50 While the composite signals x PQ of the blocks P and Q has been shown and described as being 
produced with the region divided into three zones in the horizontal direction, it is represented with no regard 
to the horizontal direction, as seen from the equations (33. a) - (33. c). The equations (33.a) - (33.c) do not 
include the terms that include x p (3M-l-m, n) and x p (3M-l-m, N-l-n), i.e., horizontal reverse-order components. 
Here, x p (3M-l-m, n) are x p (2M-l, n), x p (2M-2, n) x p (M, n) in the range of m = M, M + l 2M-I and are 

55 equal to a signal which is opposite in sequence to x p (m, n) (m = M, M + l 2M-I) in the horizontal 

direction. In this sense, x p (3M-l-m, n) are referred to as horizontal reverse-order components. Likewise, x p - 

(3M-l-m, N-l-n) are the horizontal reverse-order components of x p (m, N-l-n) (m = M, M + l 2M-I) in the 

range of m = M, M + 1 2M-I. On the other hand, the second term of the equation (33.b) that includes x p - 
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w 



(m, N-l-n) is the vertical reverse-order component of x p (m, n), (n = (N-N 0 )/2, (N-N Q )/2 + l, (N + N Q )/2-l). 
Next, as shown in Fig. 6a, assume two blocks R and S which adjoin the blocks P and Q in the opposite 
direction in contact with n = N/2. The blocks R and S are assumed to have sizes M' x N' and Ms x Ns, 
respectively. Fig. 6b shows the overlap of the blocks R and S with respect to an input signal. In Fig. 6b, the 
origin in the horizontal direction is located at the left end of the input signal of the block R for the sake of 
simplicity. The composite signal x RS of the inverse-transformed signals of the blocks R and S is also 
attainable by use of the equation used to determine the composite signal x PQ of the blocks P and Q, if m, 
M, N, M Q and N Q are resplaced with m', M', N\ Ms and Ns, respectively. As a result, in the zone m' = M', 

M' + l (3M' + Ms)/2-l; n = max { (N-N*)/2, (N-Ns)/2 } (N + N')/2-2, (N + N')/2-l, the composite signal of 

the blocks R and S is expressed as: 



75 



20 



25 



30 



35 



40 



x ss (*', n) 

XR(m f , n) . . . . (34 .a) 

(n»max{(N-N')/2, (N-N s )/2], (N-N 0 )/2-l: 

(Fig. 6b, zone 70)) 

x R (m', n) h BN Q < n " "y* + *BNO "f- + ~"3^ ) 

+ x R (m', N'-l-n) h BN0 (•§- + t& - 1-n) 



N 3N 0 



(n=(N-N Q )/2 / (N-N 0 )/2*l f . . #/ (N+N 0 )/2-l: 

(Fig. 6b, zone 71)) 



(34. b) 



.... (34 .c) 



(n=(N+N 0 )/2, (N+N 0 )/2 + l, (N+N')/2-l: 

(Fig. 6b, 20ne 72)) 



45 As the equations (34.a) - (34.c) indicate, the composite signal x RS does not include horizontal reverse- 
order components. On the other hand, regarding the equation (34.b), although it includes the term x R (m\ 
N'-l-n), i.e., the vertical reverse-order components, the vertical reverse-order components are opposite in 
polarity to those of the composite signal x PQ of the blocks P and Q. Hence, by adding x PQ and x RS , it is 
possible to cancel the vertical reverse-order components and to thereby reconstruct the input signals x p (m, 

50 n). It is to be noted that the blocks R and S may be located at any positions and have any block sizes so 
long as they adjoin the blocks P and Q at the opposite side of the line n = N/2. 

Even when the blocks P and Q adjoin each other on a vertical line, the previously stated equations free 
the decoded signals associated with the blocks P and Q from vertical reverse-order components. So long as 
other blocks adjoining the blocks P and Q are located at the opposite side of the above-mentioned vertical 

55 line, overlaying the inverse-transformed signals is successful in reconstructing input signals while cancelling 
the horizontal reverse-order components with no regard to the block size and the position in the vertical 
direction. 

As stated above, the present invention is capable of reconstructing an input signal even when a 
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bidimensional input signal is split into overlapping rectangular blocks each having a particular size. 

Referring to Fig. 7, a coding apparatus and a decoding apparatus embodying the present invention is 
shown. As shown, the coding apparatus has a dividing circuit I and a linear transform circuit 2. The dividing 
circuit I divides a bidimensional input signal into a plurality of rectangular blocks each having a particular 

5 size while generating block division information. Assuming that a given block produced by the dividing 
circuit I is Mp x Np, the linear transform circuit 2 calculates the transformed signals of M p x N p points by 
linear transform by use of 2M P x 2N P sampling points around the block of interest. The block information 
from the dividing circuit I and the transformed signal information from the linear transform circuit 2 are 
multiplexed by a multiplexer 5 and then sent to the decoding apparatus. 

w The decoding apparatus has a linear transform circuit 3 and a synthesizing circuit 4 which overlays the 
signals of blocks. The linear transform circuit 3 calculates inverse-transformed signals of 2M P x 2N P points 
by linear transform on the basis of the transformed signal data and block information which are separated 
by a demultiplexer 6. The synthesizing circuit 4 arranges the inverse-transformed signals on the basis of the 
block information and, in portions where blocks overlap, adds the signals to produce a decoded signal. 

75 Figs. 8a and 8b each shows a specific manner of dividing a bidimensional input signal into blocks. In 
Fig. 8a, a bidimensional signal is repetitively bisected in the horizontal and vertical directions a necessary 
number of times. In Fig. 8b, such a signal is divided into rectangular blocks each having a particular size. 
Regarding the basis of division, some different approaches are available, e.g., calculating the amounts of 
code of transformed signals and selecting particular division which makes the amounts of code minimum, 

20 and selecting division which makes the degree of power concentration on transformed signals representa- 
tive of the intensities of lower frequency components maximum. 

Figs. 9a and 9b each shows a specific construction of circuitry for selecting a dividing method. In Fig. 
9a, the circuitry has n dividing circuits 911-91n, n encoders or linear transform circuits 921 -92n, n coded 
signal amount calculators 931 -93n, and a single decision circuit 941. The dividing circuits 911-91n each 

25 divides a bidimensional input signal by a particular dividing method. The encoders 921 -92n each proeuces 
transformed signals with each of the blocks produced by the associated dividing circuit. The coded signal 
amount calculators 931 -93n each calculates the amount of code of the transforned signal fed thereto from 
the associated encoder. The outputs of the coded signal amount calculators 931 -93n are connected to the 
decision circuit 941. The decision circuit 941 compares one frame of bidimensional input signals derived 

30 from the respective dividing methods and outputs a selection signal indicative of one of the dividing 
methods which is smaller in the amount of coded signals than the others. The circuitry shown in Fig. 9b is 
identical with the circuitry of Fig. 9a except that the coded signal amount calculators 931 -93n are replaced 
with power intensity calculators 951 -95n. The circuitry of Fig. 9b selects one of the dividing methods which 
makes the power intensity on the lower frequencies of transformed signals maximum. The dividing circuit 1 

35 shown in Fig. 7 divides a bidimensional input signal into a plurality of blocks by using a particular method 
which is selected by the circuitry of Fig. 9a or 9b beforehand. The block information associated with each 
block, e.g., a block size and a start point are coded, multiplexed with transformed signals and then sent to 
the decoding side since they are essential in the event of decoding. The division shown in Fig. 8a, for 
example, may be implemented with the coding method described in the previously stated Chen's paper. 

40 Specifically, as Chen shows in Fig. 2 of the paper, "I" is assigned to a given block when the block is 
divided into four subblocks, or "0" is assigned when it is not divided. When the block is divided into four 
subblocks, "I" and "0" are selectively and sequentially assigned to the upper left, upper right, lower left and 
lower right subblocks. As a result, a bit sequence representative of the levels and division states of all of the 
blocks is produced. This bit sequence is used as block information. Since the size of a given block can be 

45 determined on the basis of the level of the block if the size per frame is known, block size information does 
not have to be sent. In the case of the division shown in Fig. 8b, the reference point of each block such as 
the coordinates of the upper left point and the block size may be used as block information. 

The linear transform circuit 2, Fig. 7, may be implemented by M p x N p multiplying and adding circuits 
which, assuming that the predetermined maximum block size is M p x N p , weight and add the input signals 

50 of 2Mp x 2N p points. Fig. 10a shows a specific construction of the linear transform circuit 2. As shown, the 
linear transform circuit 2 has M p x N p multiplying and adding circuits 10(1) - 10(M P x N p ) connected to an 
input signal line in parallel with each other, a block information decoder 15 for decoding block information to 
produce the size of a block of interest and the selection signal, and a selector 16 for selecting the output 
signal of one of the multiplying and adding circuits 10(1) - 10(M P x N p ) in response to the selection signal. A 

55 window function generating circuit 17 generates window functions h A M(m) and h B M(n) on a direction and 
block size basis according to the block size and input signal coordinates. A first and a second multiplier 18 
and 19 multiply the input signal x p (m, n) by the window functions h A M(nn) and h B N(n), respectively. The 
multiplying and adding circuits 10(1) - 10(M P x N p ) each has a coefficient memory 12, a multiplier 11, an 
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accumulator 13, and an address generating circuit 14. Transform operations are as follows. Assume that a 
block of interest has the size M p x N p , i.e., the maximum block size. To transform such a block having the 
maximum block size, input signals at 2M P x 2N P points centering around the block are transformed, as 
stated previously. As the equation (3) indicates, the transformed signal X p (m', n') (0 ^ m* ^ M p -I, 0 ^ n' ^ 
5 N p -I) of the input signal x p (m, n) (0 ^ m ^ 2M P -I, 0 ^ n ^ 2N p -l) is expressed as: 

2Mp-l 2N p -l 

X p (m f , n 1 ) = £ f x p On, n) h^tm) h BN (n) 
m=0 n=0 



10 



15 



x cos f (2m + M p + 1) (2m 1 + 1) */(4M p )] 
x cos { (2n + N p + 1) (2n'+l) *7(4N p )'} 

(3M 



20 In the above transform equation, h A M(m) and h B N(n) are multiplied by the input signal x p (m, n) by the 
multipliers 18 and 19, respectively. Hence, if the coefficients of second term and successive terms of the 
right member are stored in the coefficients memories 12(1) - 12(M P x N p ) of the multiplying and adding 
circuits 10(1) - 10(M P x N p ), transformed signals are attainable. For example, the coefficient memory 12(1) of 
the circuit 10(1) stores a coefficient matrix (assumed to be C|(m, n)) made up of 2M P x 2N P elements 

25 resulted from cos {(2m + M p + l) W(4M P )} x cos {(2n + N p + l) tt/(4N p )} (0 ^ m ^ 2M P -I, 0 ^ n ^ 2N P -I) as 
transform coefficients for blocks of the maximum size. Likewise, the coefficient memory 12(M P x N p ) of the 
"M p X N p " multiplying and adding circuit 10(M P x N p ) stores a coefficient matrix of 2M P x 2N P elements 
resulted from cos {(2m + M p + l) (2M P -I) W(4M P )} x cos {(2n + N p + l) (2N P -I) W(4N P )} . It will be seen from 
the equation (3') that the coefficient changes with the block size. Hence, a plurality of coefficient matrixes 

30 each being assigned to a particular block size are stored in each coefficient memory. Which of such 
coefficient matrixes should be selected is determined on the basis of block information which the block 
information decoder 15 produces. Implemented by ROMs, for example, the address generating circuits 14(1) 
- 14(M P x N p ) each generates, in response to block size information from the block information decoder 15, 
the leading address of associated one of the coefficient memories 12(1) - 12(M P x N p ) where a coefficient 

35 matrix matching the block size of interest is stored. A reading circuit, not shown, sequentially reads in 
synchronism with the input signals the transform coefficients C| (m, n) associated with the block of 
maximum size out of the leading address having been designated by the address generating circuit 14(1). 
The multiplier 11(1) multiplies the window function-multiplied input signals x p (m, n) h A M(m) * h B i\i(n) by the 
transform coefficients C| (m, n). The accumulator 13(1) accumulates the results of multiplications to produce 

40 a transformed signal Xp (0, 0). The other multiplying and adding circuits also perform similar operations in 
parallel. As a result, transformed signals X p (0,0) - X P (M P -I, Np-I) are obtained. The transformed signals X p - 
(m', n') are sequentially selected by the selector 16 and fed therefrom to the multiplexer 5. The selection by 
the selector 16 is controlled by the selection signal which is generated by the block information decoder 15. 
Specifically, the block information decoder 15 has, for example, a table listing the correspondence of the 

45 input signals of the selector 16 and the transformed signals X p (m\ n') and controls the selector 16 in such 
a manner as to select only necessary ones of decoded block information. In the case of a block of 
maximum size, the decoder 15 generates a selection signal such that the selector 16 sequentially selects 
the output signals of all of the multiplying and adding circuits, the output signal X p (0, 0) of the circuit 10(1) 
being first, for example. The resulted transformed signals x p (m', n') are multiplexed with corresponding 

so block information by the multiplexer 5, Fig. 7, and then transmitted to the decoding side. The window 
function generating circuit 17 will be described more specifically hereinafter. The present invention assigns 
different window functions on a direction and block size basis. Moreover, the values of window functions 
change from one region to another of the input signal, as described above. For this reason, the window 
function generating circuit 17 of the linear transform circuit 2 shown in Fig. 10a and located at the coding 

55 size generates window functions h AM (m) and h BN (n) in response to the input signal and block information. 
Fig. 11a shows a specific construction of the window function generating circuit 17. In Fig. 11a, the input 
signals x p (m, n) and the block information are applied to a data counter 51 and a separator 31, respectively. 
The data counter 51 counts the input signals x p (m, n) to produce the coordinates m and n of the input 
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signals. The coordinate m in the horizontal direction and the coordinate n in the vertical direction are fed to 
a first region decision circuit 32 and a second region decision circuit 42, respectively. The separator 31 
separates the block information from the block information decoder 15 into a horizontal block size M and a 
vertical block size N and transfers the resulted block sizes M and N to the decision circuits 32 and 42, 

5 respectively. Since the two region decision circuits 32 and 42 are identical in construction and operation, let 
the following description concentrate on the region decision circuit 32 by way of example. The region 
decision circuit 32 has n threshold generating circuits 321 -32n, n comparators 331 -33n, and a counter 34. 
On receiving the horizontal block size M, the threshold generating circuits 321 -32n generate corresponding 
n threshold values. The comparators 331 -33n compare the horizontal coordinate m of the input signal with 

w the n threshold values. The counter 34 receives the outputs of all of the comparators 331 -33n to determine 
the number of comparators that have outputted a coincident output. More specifically, the threshold 
generating circuits 321 -32n determine, on the basis of the horizontal block size M, the value of horizontal 
coordinate m where the value of the window function h AM (m) corresponding to the block size changes. 
When the window functions are configured as shown in Figs. 4a - 4c, four threshold values, i.e., (M/2-M 0 /2), 

75 (M/2 + Mo/2), (3M/2 - M 0 /2) and (3M/2 + M 0 /2) are needed. Since the minimum block size in the horizontal 
direction is determined beforehand, the threshold values can be generated if the horizontal block size M is 
given. The number of threshold generating circuits may be determined in matching relation to the window 
function h AM (m) whose maximum number changes. Corresponding one-to-one to the threshold generating 
circuits 321 -32n, the comparators 331 -33n compare the horizontal coordinate of the input signal from the 

20 data counter 51 with the threshold values from their associated threshold generating circuits 321 -32n and 
generate a pulse when they are coincident. The output pulses of the comparators 331 -33n are applied to 
the count terminals of the counter 34, so that the counter 34 outputs the number of input pulses. The 
number of pulses is indicative of a particular region to which the horizontal coordinate m of the input signal 
belongs. Fig. 12 tabulates a relation between the horizontal coordinate m of the input signal and the output 

25 or the counter 34. In Fig. 12, the counter 34 is assumed to be a 4-bit counter. A ROM 35 stores window 
functions h AM (m) assigned to the horizontal direction. The lower bits and the upper bits of the address 
terminal of the ROM 35 are allocated to the output of the counter 34 and the horizontal block size M, 
respectively. Consequently, a particular window function matching a block size is selected with the result 
that the value of the window function is changed in association with the horizontal coordinate of the input 

30 signal. Fig. 13 shows a specific relation between the address of the ROM 35 and the content thereof on the 
assumption that the window function h AM (m) has five different values depending on the horizontal coordinate 
of the input signal. Likewise, the second region decision circuit 42 produces a window function h B i\i(n) 
matching a vertical block size of interest from a ROM 45 on the basin of the vertical block size N and the 
vertical coordinate n of the input signal. A counter 44 and the ROM 45 are respectively identical with the 

35 counter 34 and the ROM 35 except for the replacement of m, M, M 0 and h AM (nn) with n, N, N 0 and h B N(n). 

Referring again to Fig. 7, the block information and transformed (coded) signal multiplexed by the 
multiplexer 5 and then transmitted are separated by the demultiplexer 6. The transformed signal X p (m', n') 
and the block information are applied to the linear transform circuit 3 and the synthesizing circuit 4, 
respectively. Fig. 10b shows a specific construction of the linear transform circuit 3 which is substantially 

40 identical with the construction of Fig. 10a except for the number of multiplying and adding circuits 20(1) - 20- 
(2M P x 2N P ). As the equation (4) indicates, an inverse-transformed signal y (m, n) (0 ^ m ^ 2M P -I, 0 ^ n ^ 
2N P -I) derived from a transformed signal X (m', n') (0 ^ m' ^ M p -I, 0 ^ n' ^ N p -I) is expressed as: 



45 



50 



55 



Mp-l n -1 

y p (m, n) = y v X (m« , n') f^On) f fiN (n) / (MpN D ) 
in*0 n r -0 

x cos { (2m + Mp + 1) (2m' ^ 1) ir / (4Mp) } 

x cos { (2n + Np + 1) l2n' + X) nf (4M p ) "} 

(*') 

A first and a second multiplier 28 and 29 multiply respectively the transformed signal x(m', n') by f AM - 
(m) and f B i\i(n)/(MN) included in the above inverse transform equation. Coefficient memories 22(1) - 22(2M P X 
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2N P ) included in the multiplying and adding circuits 20(1) - 20(2M P x 2N P ), respectively, store the coefficients 
represented by the second term and successive terms of the right member. The coefficient memory 22(1), 
for example, stores inverse-transform coefficients associated with the block of maximum size which are an 
inverse-transform coefficient matrix (assumed to be C|" l (m , J n')) of M p x N p elements represented by cos {- 
5 (Mp + I) (2m f + l) W(4M P )} x cos {(N p + i) (2n' + l) tt/(4N p )}(0 S m' S M p -1, 0 ^ n* ^ Np-I). Likewise, the 
elements constituting the inverse-transform coefficient matrix 



v '2M p x 2N D 

w f y 

(m\ n*) stored in the "2M P x 2N P " coefficient memory 22(2M P x 2N P ) and associated with the block of 
maximum size are represented by cos {(5M P -I) (2m* + 1) W(4M P )} x cos {(5N P -I) (2n' + l) W(4N P )} (0 ^ m' ^ 
Mp-I, 0 ^ n' ^ N p -I). The inverse-transform coefficients, like the transform coefficients, change with the block 

15 size. Hence, the coefficient memories each stores a plurality of inverse-transform coefficient matrixes 
matching different block sizes. A block information decoder 25 and address generating circuits 24(l) - 24- 
(2M p x2Np) included in the multiplying and adding circuits cooperate to cause particular inverse-transform 
coefficient matrixes to be selected in matching relation to the block size. The selection principle is the same 
as with the coding linear transform circuit 2 and will not be described for simplicity. The inverse-transform 

20 coefficient matrix 




25 

(m', n') selected out of the coefficient memory 22(l) by the address generating circuit 24(l) is sequentially 
read out in synchronism with the transform signals X p (m\ n') under the control of a reading circuit, not 
shown, and multiplied by the multiplier 21(1). An accumulator 23(1) accumulates the results of multiplications 
to produce y p (0, 0). The other multiplying and summing circuits also perform such operations in parallel. As 

30 a result, y p (0, 0), y p (0, I) y p (2M P -I 2N P -I) are obtained. A selector 26 sequentially selects the inverse- 
transformed signals y p (m, n) in response to selection signals from a block information decoder 25 and 
transfers them to the synthesizing circuit 4. Fig. 11b shows a specific construction of the window function 
generating circuit 27 shown in Fig. 10b. The circuitry shown in Fig. 11b is identical in construction and 
operation with the circuitry of Fig. 11a except for a multiplier 66 and a divider 67, and redundant description 

35 will be avoided for simplicity. The multiplier 66 and divider 67 are used to perform the division of the right 
member by the product of block sizes MN which occurs only in the inverse-transform equation (4) or (4'). 
Specifically, the multiplier 66 produces the product MN of horizontal and vertical block sizes M and N which 
a separator 61 outputs, while the divider 67 divides a vertical window function f B i\i(n) for decoding read out 
of a ROM 75 by the product MN, i.e., it produces f BN (n)/MN. While the specific construction of Fig. 11b 

40 divides the vertical window function f B iv(n) by the product MN of block sizes, it may be modified to divide 
the horizontal window function f A ivi(n) or the division may be effected by any other section of the linear 
transform circuit 3, if the inverse-transform equation (4') can be executed. 

Referring to Fig. 14, a specific construction of the synthesizing circuit 4 is shown. As shown, the circuit 
4 has a block information decoder 91, a memory 93 whose capacity is great enough to accommodate one 

45 frame of bidimensional input signals, and an address generating circuit 92. The block information decoder 
91 outputs block origin information in response to block information fed thereto from the demultiplexer 6. 
The address generating circuit 92 generates an address signal meant for the memory 93 in response to an 
inverse-transformed signal and block information. An adder 95 adds signal data read out of the memory 93 
and being decoded and a inverse-transformed signal. A decoding controller 94 controls the reading and 

50 writing of data in the memory 93 while decoding is under way. A reading controller 96 controls the read-out 
of one frame of decoded signals associated with bidimensional input signals. In operation, the block 
information decoder 91 produces, in response to block information separated by the demultiplexer 6, Fig. 7, 
a transform-coded block size and the position of the origin of the block (assumed to be the upper left point) 
in an input signal frame (block origin coordinates). The address generating circuit 92 generates a particular 

55 address of the memory 93 for writing a transformed signal on the basis block origin coordinates and block 
size. The memory 93 has an address space identical with the sampling points of one frame of bidimen- 
sional input signals and is used for temporary storage during the course of decoding operation. On 
receiving the inverse-transformed signal y(m,n), the decoding controller 94 reads corresponding signal data 
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being decoded out of the memory 93 within one sampling time of the inverse-transformed signal. Then, the 
decoding controller 94 writes in the same address the sum of the signal data and inverse-transformed signal 
which the adder 95 produces. As a result, inverse-transformed signals in a region where k blocks overlap 
are added k times. When the frame of input signals changes, the decoding controller 94 generates an end- 
5 of-decode signal to inform the reading controller 96 of the end of decoding. To detect the change of frame, 
a frame pulse usually included in a picture signal may be detected. In response to the end-of-decode 
signal, the reading controller 96 reads data out of the leading address of the memory 93 and sequentially 
outputs them as a decoded signal. On reading out all the data, the reading controller 96 resets the contents 
of the memory 93. 

w By the operations described above, the present invention produces correct decoded signals even when 
a bidimensional input signal is divided into blocks each having a particular block size and overlapping the 
others. Among the window functions assigned to the linear transform circuits 2 and 3, the window functions 
hAMo(m)> h B No(n), fAMo(inn) and f B No(n) for the block of the minimum size may be implemented as the window 
function represented by the equation 9 of the previously stated H. Schiller's paper or the window function 

75 shown in table 1 of J. P. Princen et al "Analysis/Synthesis Filter Bank Design Based on Time Domain 
Aliasing Cancellation", IEEE Transactions on Acoustics, Speech, and Signal Processing. Vol. 34, No. 5, 
October 1986, pp. 1153-1161. It is to be noted that h A Mo(>nn) and h BN0 (n) may have an identical configuration 
when the block of interest is square, i.e., Mo = No so long as they satisfy the equations (6. a) - (6.d). 
Regarding the window functions h A M(m), h B N(n), fAivi(m) and f B isi(n) for block sizes other than the minimum 

20 block size, assuming in the equations (7.a) - (7.n) 



25 



30 



f^tm) = IAZam f amd (in) 
h BN (n) = tt BN h BN0 (n) 
f BN (n) = i/a BN f«BNO (n) 



35 



then 
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<*AM k/tfK) (»-M/2+Mo/2) 
<*AM 

<*AM hAMO(»-3M/2+3Mo/2) 
0 



(m <. M/2-Mo/2) 
(M/2-Mq/2 ^ m< M/2+Mq/2) 
(M/2+Mo/2 £ m <L 3M/2-Mq/2) 
(3M/2-Mq/2 £ m<: 3M/2+Mq/2) 
(» & 3M/2tMo/2) 



h BN 



°BN h BN0 (n-N/2+N 0 /2) 



a m h BKO (n-3N/2+3N 0 /2) 
0 



(n < N/2-N 0 /2) 
(N/2-N 0 /2 £ n < N/2+N 0 /2) 
(N/2+N 0 /2 S n -C 3N/2-N 0 /2) 
(3N/2-N 0 /2 £11 <3N/2+N 0 /2) 
(n ^3N/2+N 0 /2) 
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f AM (») 



0 (m < M/2-Mo/2) 

fAMo(»-M/2+M 0 /2)/0! AM (M/2-Mo/2^ m<M/2 + Mo/2) 

1/^5 m/2+-Mo72 ^ m< 3M/2-Mq/2) 

f AMO (m-3M/2*3M 0 /2)/a AM (3M/2-MQ/2 £ m<T 3M/2 + Mq/2) 

0 (m S.3M/2 + Mq/2) 



0 N/2 -N 0 /2) 

f BNO (n-N/2 + N 0 /2) /Q! BN (N/2-N 0 /2 £ n -C N/2 + N 0 /2) 

l/<X B y (N72+N 0 /2^ n< 3S/2-N 0 /2) 

fBNO^-3 N /2+3M 0 /2}/Q: BN (3N/2-N 0 /2 £ n<l 3S/2*N 0 /2) 

0 (n S 3IJ / 2 + N 0/2> 



This is successful in reconstructing, when a transformed signal with no artifacts is decoded, an input signal 
35 in the decoded signal. In the above window functions, a AM and c* B n are constants. Specifically, assuming 
that M = N = 16 and M 0 = N 0 = 8, the window functions may be selected as: 
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h AMO< m) " f AMC< m) " h BNO <m) = f BNO (m) 



10 



= I sin (m+ (m - 0, 1, 15) 

0 (m <£ 0 or 16 ■< m) 



75 



20 



25 



sin 



J7 a 
2 



♦ 



sin 



( 



T6 



(ra- 



2 ' J 



(m < 4) 



<a = 4 , 5 , . . . / 11) 



( ni= 12, 13, - . - , 19) 



(m = 20, 21, 27) 



(m > 28) 



30 

In a modified form of the present invention, the window functions may be changed in matching relation 
to the size of the block adjoining the block of interest. Assuming M = N = 16 and M 0 = N 0 = 8 as 
mentioned above, when a block of 16 x 16 size adjoins a block of interest whose size is 16 x 16 at the right- 
hand side of the latter in the horizontal direction, the right half (m 16) of the window functions h A M(m) and 
35 f A M<m) may be 



40 



f sin (m+ (m = 16, 17, 31) 



(m i 32) 



45 The same holds true for the block adjoining the block of interest at the left-hand side of the latter and the 
top or the bottom of the block of interest. When blocks neighboring the block of interest are of 16 x 16 size, 
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( 0 



55 



(ft < 0) 



(m = 0/ 1, 31) 



(m a 32) 
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In summary, the present invention produces a decoded signal by adding the inverse-transformed 
signals of nearby blocks. This not only reduces block boundary artifacts but also allows the block size to be 
changed in matching relation to the characteristic of a signal. The present invention, therefore, achieves 
extremely efficient coding by selecting a comparatively large block size in, for example, an area occupied 
5 by the same pattern or a comparatively small block size in, for example, an area where the characteristic of 
the signal sharply changes. Another advantage attainable with the present invention is that the number of 
sampling points of a signal to be transmitted is the same as that of an input signal. 



Claims 



70 



1. A method of coding and decoding a bidimensional signal, comprising the steps of: 
at a coding side 

(a) dividing a bidimensional input signal into rectangular blocks of a plurality of sizes; 

(b) providing window functions h A ivi(m) and h B N(n) on a direction and block size basis; 

75 (c) calculating, assuming that a block of interest has an M x N size, transformed signals X p (i, i) from 

input signals x p (m, n) (m = 0, I, 2M-I; n = 0, I, 2N-I) by a transform equation: 

2M-1 2N-1 

X (k, i) = I 2 x (m, n) h^fm) h BN (n) 
p m-0 n=0 p 



20 



25 



X cos {(2m + M*l) (2k* 1) */(4M)} 
x cos [I2n + B+ D (2i + 1) x / (4N)} 
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45 



(k « Q, 1, M-l; i - 0, 1, N-l) 



(d) transmitting block division information and said transformed signals to a decoding side; 

at said decoding side 

(e) providing window functions f am (m) and f B N (n) corresponding to said window functions h A M (nn) 
and h B M (n), respectively; 

35 (f) calculating, when a block size of said transformed signals sent from said coding side is M x N, 

inverse-transformed signals y p (m, n) of 2M x 2N points from said transformed signals by using a 
transform equation: 



M-l N-l 

y <», n) = I 2 X (k, i) f AM (m) f BN (n) / (MN) 
P k=0 i«0 P 



x cos {(2m + M+l) (2k +1) ?r/(4M)} 
x cos { (2n + N + 1) (2i + 1) */ (4N)} 



50 (m • 0, 1, 2M-1; n * 0 7 l f 2S-1) 

(g) arranging said inverse-transformed signals according to said block division information sent from 
said coding side; and 

(h) adding, in a portion where a plurality of blocks overlap, said inverse-transformed signals to 
55 produce a decoded signal. 

2. An apparatus for coding a bidimensional signal, comprising: 

means for dividing a bidimensional input signal into rectangular blocks of a plurality of sizes; and 
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means having window functions h A M (m) and h B N (n) on a block size and direction basis for 
calculating, when a block of interest has an M x N size, transformed signals X p (k, i) of M x N points 
from input signals x p (m, n) (m = 0, I, 2M-I; n = 0, I, 2N-I) of 2M x 2N points centering around 
said block of interest by using a transform equation: 



2M-1 2N-1 

X (k, i) « £ 2 x in, n) hj^im) h BM (n) 
5 rn=t> ti*« ^ 

x ccs { (2m * M + 1) (2k + 1) / (4M) } 

x cos { (2n + N + 1) (2i + 1) nt 

(k = 0, 1, M-l? i = 0, 1, N-l) 



said block division information and said transformed signals being outputted. 

An apparatus for decoding a bidimensional signal, comprising: 

means having window functions f A i\/i(nn) and f B N(n) corresponding respectively to window functions 
hAivi(m) and h B N(n) recited in claim 2 for calculating, when transformed signals transmitted from a 
coding side have a block size of M x N, inverse-transformed signals y p (m, n) of 2M x 2N points from 
input transformed signals by using a transform equation: 

M-l N-l 

y (irir n) = I 2 X (k, i) f^tm) ff BN (n)/(MN) 
P k=0 i-0 p 

x cos j(2m + M*l) (2k* 1) */<4M)] 
x cos £(2n + N + 1) (2i + 1) *r/(4N)] 

(m = 0, 1, 2M-1; n « 0, 1, 2N-1) 

means for arranging said inverse-transformed signals according to block division information 
transmitted from said coding side and, in a portion where a plurality of blocks overlap, adding said 
inverse-transformed signals to produce a decoded signal. 
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Fig. 3 
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